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A Note on Box's General Method of Approximation for 
the Null Distributions’ of Likelihood Criteria^ - 

by 

Leon Jay Gleser 

The Johns Hopkins University and Educational Testing Service 

and 

Ingram Olkin 

Stanford University and Educational Testing Service 
1» Introduction 

Many multivariate test statistics (such as the likelihood ratio test 
statistic for MANOVA and the Bartlett modification of the likelihood ratio 
test statistic for testing the equality of covariance matrices) have null 
distributions whose h -th moment is of the form 



J 



(1.1) Mb = K 



n (yj 1 

3-i J 

1 X i: 

n (x.) 1 

=i 



y. \ h I 



JI r(x.(l + h) + |.) 



i=l 



\ i= 



n r(y.(i + h) + n,) 

j=i 3 3 



> h — 0, 1,2, . . . , 



where K is a constant (such that M Q = 1 ), the x's and y's are positive 
numbers, and 



I J 

(1.2) Z x = Z y . 

i=l j=l 3 

Such statistics have a range of variation from 0 to 1, so that the moments 
M h > h = 0, 1, 2, ... , determine the null distribution. 
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For any statistic W , 0 < W < 1 , whose moments are of the form (l.l), 

Box (19^9) has proposed an asymptotic expansion for the cumulative distri- 
bution function (c.d.f.). This expansion provides an accurate method for 
determining the critical constants defining rejection regions for the multi- 
variate tests mentioned above. One form in which this expansion is often 
given [see Anderson (1958; P* 207)3 is the following: 

(1-3) P(-2 log W < t) = (1 - <t>)P{Xf < Pt) + < P*) + R (&) * 

I J 

Here, & = Z x. = Z y. , 
i=l 1 j=l 1 

1 J i 

(1.4) f = -2[ 2 | - Z n - f (I - J)] , 

i=l 1 j=l 3 

( 1 . 5 ) <j> = — [ z x" 2 b,((i - p)x. + i. ) - z y i 2 B,((i - p)y. + H.)] , 

- 6 p i=l 1 5 1 1 j=i 3 5 3 3 

p is the solution of the equation 

( 1 . 6 ) z^ x“‘ l b 2 ( (1 - p)x i + $.) - z^ yj b 2 ((i - p)y. + n..) = 0 , 

and R(&) is a remainder term. [Note: p is chosen so that Anderson's 

is 0.3 Also B^(u) , Bg(u) , and B^(u) are the Bernoulli polynomials of 
degree 1 , 2 , and 5 defined by: 

(1.7) B x (u) = u - | , B 2 (u) = u 2 - u + g , B 5 (u) = u 5 - J u 2 + 




3 
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If lim 5 ^"x. >0 and lim (l - p)x^ exists, i - 1,2,*#., I , 

& co 1 5 -» 05 

and if lim & - 1 y* > 0 and lim (l - p)y. exists, j = 1,2, * **,J , then 
6 -»« 3 6 3 

Anderson (1958, pp. 205-207) sketches an argument which shows that the re- 
mainder term R(s) in (l«3) is 0(5 ^) as 6 00 • In the case of the 

likelihood ratio test for MANOVA, Anderson (1958) gives examples showing the 
high accuracy provided by the approximation (1*3)* 

Determination of the constants <t> and p defined by (1*5) an d (1.6), 
respectively, is usually a very cumbersome task. In Section 2, v/e show how 
this task can be considerably simplified by taking advantage of certain 
relationships among the Bernoulli polynomials B^( u ) > ^ = ^^5 • As a 

result, we obtain convenient formulas for f , p , and <t> for the 
important special case (which includes the null distributions of the like- 
lihood ratio test statistic for MANOVA and for various special cases of the 
likelihood ratio test statistic for independence of sets of variates) in 
v/hich T = J , the x^'s and y..'s are equal, is linear in i , and 

tj . is linear in j ■ 

J 

Let and W g be two statistically independent random variables, 

where each W. has range of variation from 0 to 1 and has moments of the 
form (1.1). It follows that au asymptotic expansion (1.3) for the c.d.f. 
of can be given, i = 1,2 . Let f^ , p^ , and be the constants 

in the asymptotic expansion (1.3) for the c.d.f. of W. , i = 1,2 , and 
suppose that the values of f^ , fg > > Pq 7 *1 * and *2 are 

known to us. Let W = . It can easily be shown that 0 < W < 1 and 

that the moments of W have the form (l.l). Thus, one can obtain an 
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asymptotic expansion (1.3 ) for the c.d.f. of W . Although the constants 
f , p , and <t> in this expansion can be obtained ab initio by calculating 
the moments of W and then using formulas (1.4) through (1.6), or the 
simplifications of these formulas given in Section 2, it would be more 
convenient to obtain the constants f , p , and <t> directly from the 
given values of f 1 , , p x , p 2 , * 1 , and <t> 2 . Formulas for doing 

this are given in Section 3 « Section 4 provides two illustrations of the 
method. 



2. Simplification of the Formulas for p and <t> 

In this section it is shown that if the h -th moment of the random vari 
able W , 0 < W < 1 , is given by (l.l), then the constants p and <t> 

in Equation (1.3) can be obtained as follows: 



(2.1) p = 1 - i [ z x‘ 1 B 2 (i i ) - z yj^Oi.,)] , 



i=l 



and 



(2.2) 0 = - ^ [ s x‘ 2 b 5 (|.) - z yJ 2 B 5 (n 5 ) + I (1 - p) 2 f] , 



6p i=l 



v/here f is- given by (1.4). 

To verify (2.1), note from (1.7) that 

(2.3) B 2 (w + v) = Bg(v) + 2wB i (v) + w 2 , 



O 

ERIC 



5 



and hence 



L 
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(2.4) £ u‘ B 2 ((l - p)u t + v t ) 

i=l 



L L a 1* 

= Z u “ 1 Bg^) + 2(1 - p) £ B 1 (v i ) + (1 - p) 41 Z 
i=l i=l i - l 



Note that 



( 2 - 5 ) 



2 BM.) 
i=l 



2 B,(tjJ 
3=1 3 



= 2 - 



i=l 



1 1 

f I - z n, + 2 J 

d=i 3 






i J 

Since £ x. = £ y . , it follows from (1.6), (2.4), and (2.5) that p is 



i=l 1 3=1 J 



the solution of 



(2.6) £ x” 1 B 2 (l i ) - £^ y‘ 1 B 2 (^) - (1 - p)f = 0 , 



i=l 



3=1 



which is equivalent to (2.1). 

To verify (2.2), note from (1*7) that 



2 3 

(2.7) B,(w + m) = B, (v) + 5 wB 2 (v) + 5wB 1 (v) + w , 



and hence 



L _p 

2 u t B 5 ((l - p)^ + v t ) 



i=l 



( 2 . 8 ) 



= £ u7 2 B (v ) + 3(1 - p) £ u?^ (v ) 

i=l p i=l 



+ 5(1 - P) 2 2 B. (v. ) + (1 - P 9 2 u 
i=l 1 1 1=i 

6 



>rM ■ 

■ M 
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Equation (2.2) now follows from (l»5)> (2.1), (2. 5 and. the fact that 

I J 

Z x. = 2 y. . 

1=1 1 i-l 1 

If the h -th moment of W has the form (l.l) with I = J £ L , 

x x = x 2 = ... = Xj = y x = y 2 = ... ■ 3Tj 5 ^ = a + bi , i = 1,2,..., I , 

and tj. = c + dj , j = 1,2, ...,J , then from (1.4), 

J 

L L 

(2.9) f = -2[ Z (a + bi) - Z (c + dj)] 

i=l j=l 

.= -2L[ (a - c) + | (b - d)(L + 1)3 • 

Also, from (2.1), (2.9), and (1.7), 

- L 0 ' L L p I* 

p = 1 - i [ Z (a + bi) 2 - Z (a + bi) - Z (c + dj) + Z (c + dj)] 

Tz i=l i=l j=l j=l 

(2.10) 

= 1 - tt- [(a 2 - c 2 ) + (ab - cd)(L + l) + \ (b 2 - d 2 )(L + l)(2L + l) + §£ 



Finally, note from (1*7) that 

Bj(u) = u 5 - | B 2 (u) - B 1 (u) - £ 

From this fact, (2.1), (2.2), and (2.5), it follows that 



ERIC 
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-6z 2 p 2 <t> = Z [(a + bi) 3 - (c + di) 3 ] - 4 (l - p)zf + §■ 



i=l 



( 2 . 11 ) 



+ | (1 - p) 2 z 2 f . 



By a direct evaluation we have that 



k ^ * 

Z [(a + hi)'' - (c + di)"j 
i=l 



(2.12) = (a 5 - c 3 )L + | (a\ - c 2 d)(L)(L + l) 

+ | (ab 2 - cd 2 )(L)(L + 1)(2L + l) + £ (b 3 - d 3 )(L 2 )(L + l) 



Thus, (2.11) and (2.12) together give us a formula for computing <t» 

3 • Approximation for the Distribution of the Product of 
Independent Statistics Whose Moments Are of the Form (l.l) 



Let the independent random variables W , 0 < W < 1 , be 

g g 

independent, with h -th moment of the form 



/ J 



(3.1) E(W g ) h = K g 



g y,.« 
n (y^) ** 



. i 
\ h g 






go 



g x . 

n (x .) 61 
\i=i gl 



n r(x .(i + h) + | .) 

i=i s 1 «i 

“j 

g 

n r(y .(1 + h) + tj . ) 



j=i 



S3 



gJ' 



h =0,1,2 



g 



where K is a constant (such that Ew = 1 ), and Z x . = Z y . , 
g g i=1 gi i=1 gi 



for g = 1, 2 . Let 



8 



} 



(5.2) 



w = w x w 2 



It then follows that E(w) h = E(W 1 ) h E(W 2 ) h , and hence the moments of W 
are of the form (l.l) with I = I- + Ig , J = + J 2 , 





[ x u > 




5 li V 


if 


i = 


1,2, 


X. = i 




-< 










1 




i 


*2, i-I x ' 


if 


i = 


y 


(5.3) 

t 


f y ij ' 




|’TJ. . , 

1J 


if 


j = 


1,2 


y, = < 




% = < 














0 


n 2,j-J x > 


if 


i = 


V 



I J 

Note also that E x. = E y. = 5 . 

i-1 1 >1 3 

Since the moments of , Wg , and W are all of the form (l.l), it 

follows from the results of Sections 1 and 2 that the c.d.f.'s of these 

three variables can be expanded in the form (1.3). The coefficients f , 

8 

p , ♦ for the expansion of the c.d.f. of W , g = 1,2 , and the 

68 6 

coefficients f , p , ♦ , for the expansion of the c.d.f. of W are 

expressible by means of equations (2.5), (2.l), and (2.2). From these 
expressions and (3*3), it can be shown by some straightforward algebra 
that 



(5.4) 

(5.5) 



f " f i + f 2 ' 



P = 



f l P l + f 2 p 2 



and 



O 
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(3.6) 



2 2 
p l<>l + ( 3 2 <S> 2 

2 ' + 
P 



f l f 2 

4fp 2 




Equations (3*4), (3*5), and (3*6) thus provide a way to compute the co- 
efficients f , p , and <t> in the expansion (1.3) of the c.d.f. of 
W = WjWg in terms of the coefficients f g , Pg ; an< * '•'g *he e - P ans i° n 
(1.3) of the c.d.f. of W , g * 1,2 . We may generalize these results by 
induction and obtain the following: 



Theorem 1 . Let the statistically independent variables W g , 0 < W g < 1 , 

have moments of the form (3«l)> S = 1,2,. ..,6 * Let f g , p g , > 

I J 

g g 

and & = 2 x = Z y . be the constants in the Box expansion (1.3) 

6 i=l j=l gJ 

of the C.d.f. of W , g=l,2,...,G . Finally, let 



G 

(3.7) W = H W . 

g=l 6 



Then 



(3-8) P{-2 log W < t) = (1 - <t>)P{X^ < pt) + < pt) + R(&) , 



G G , G 

where & = 2 & , f « 2 f , P = 7 2 f p ,>and 

g=l g g=l g f g=l E 8 



1 G 

"T? \ 

P g=l 



2 

p <t> + 

g g 



4p f g<3i 



f fu(p - 
g h v g 






O 
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Two applications of Theorem 1 to multivariate testing problems are gives.? 
in Section 4. Note that if in the Box expansions for , each 

R (& ) is 0($”^) as 6 ->» , and if ...,8 are all asymptotically 

of the same order of magnitude (i.e., lim 8 8^ >0 as 8 ,8^ n f° r 



g 

-5? 



all g / h ), then R(b) in (3*8) is 0(8 ) . In practical use of 

Theorem 1, the 8 ' s will usually be asymptotically of the same order of 
8 

magnitude. If the 8 1 s are not asymptotically of the same order 

6 

of magnitude. Equation (3*®) is formally correct (when 8 , f , p , 
and o are defined as in Theorem l), but the order of magnitude of the 
remainder term R(8) in 8. must be separately investigated. 

4. Applications to Multivariate Hypothesis Testing Problems 

Suppose we are interested in testing whether either the mean vectors 
and/or covariance matrices of k multivariate normal populations are 
identical. Suppose that an observation ( p dimensional row yQff-iov) x ' — 
from the i -th population has a p -variate normal distribution with mean 
vector and covariance matrix E^ , i = 1,2, ...,k . Let ^ 

partitioned as (x^^Xg^) , where x^*^ i s 1 x > an ^ l e * 

(0 / 2 n 



be 



(4.1) p (i) = (p^,^) 



is 


1 x q , and let 


(i) 


s (i)\ 


’ll 


12 1 , 


.(i) 


s (i )J 


‘21 


^22 / 


,k • 


Suppose that we 


i = 


1, 2, • • • , k • 



We consider two tests of hypotheses. The first test compares the null 



hypothesis. 
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(4.2) 



H 



mvc 




• • • 




= Z^ = ... = z^ 



> 



against general alternatives. In the second test, we compare the null 
hypothesis against the alternative: 



(4o) 



H 



m' vc ' 




Z 



(D _ v(2) _ 

11 “ *11 • 




Let 



;(i) = 



r^) = 



(x^x^) be the sample mean vector and let 



/ V (i > 

11 



12 



r( i > v(i)j 



21 



'22 



be the sample cross-product matrix from the i -th population, i = 1, 2, ...,k 

Then (x^,x^ 2 ^, . . .,x^,V^,V^, . . «,V' k ^) is a sufficient statistic 

k 

for both hypothesis testing problems. Let N = Z. N. , 

i=l 1 



x = (x^Xg) = | Z M (x[ l \x| 1 ^) , 

i=l 

and 

= Z N. (x^ 1 ^ - x ) 1 (x^^‘ - x) 

1=3. 1 

4.1 Test of H Versus General Alternatives 
mvc 

Anderson (195&) suggests testing H mvc against general alternatives ty 

means of the test statistic 





/* o 

* /-• 
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= W,W, 



12 . * 



where n. = N . - 1 , i * 1,2 
ii 



k 

,k , and n = Z m • 



i=l 



. The statistic 

= ... = 



is the likelihood ratio test statistic for testing Z 



O 

ERIC 



against general alternatives, but modified [along lines suggested by 
Bartlett (l957)Jby everywhere replacing the sample sizes by the degrees 



the likelihood ratio test statistic for MANOVA. 

As Anderson (1958) shows, the statistics and W g are independent 



Thus, the moments of W, under H are of the form (l.l), and we can 
use the Box expansion (1-5) for the c.d.f. of W when N^, • • • , are 
large and of the same order of magnitude. Although the constants f^ , , 

and $ in the expansion ( 1 . 3 ) of the c.d.f. of can be obtained directly 

from (4.5) by use of the methods of Section 2, Anderson (1958; p* 255) has 



of freedom, n ± , of V' 1 ' . The statistic Wg is the (n/N) -th power of 



when H holds, and also 
mvc 



(4.5) E(w L ) h = k l 



i=l s=l 



k p , , 

n n r( | n ± (i + h) + | (1 - s)) 



n r( |n(i + h) + | (1 - 1 )) 
t=i 



already shown that 
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f l = | (k - l)p(p + 1) > 



. k 1 1 \ 2p^ + 3 p - 1 

P 1 = 1 " ( n^[ " n ^ Sfo 4 l)'(k - IT ’ 



(4.6) 



p(p + l)[(P - 1 )(p + 2 )( s ^ ) ” ( n ) ) " “ 1 ^ 1 “ p l^ ^ 



•l" 



i=l i 



48p* 



[In comparing (4.6) with Anderson's results it should be noted that his q 
is our k .] 

Anderson (1958; p. 207) gives the h -th moments of ?v = (W 2 ) N / n 

under H as 
mvc 



n r( | N(1 + h) - | (k - i) - \ s) 

(4.7) E(?o h = k 2 ^ — - : 

n r( | n(i + h) - 2 t) 

t=l 



where (4.7) holds for all real h for which the gamma functions exist 
Hence, 





h 



n r( \ n(l + h) + i - | s) 



(4.8) E(W p ) = K. 



s=l 



2 p 



n r( h n(l + h) + | - 1 1 ) 



t=l 



Thus, applying (2.9), (2.10), (2.1l), and (2.12), with L = p , z = n/2 , 
a = 1/2 , b = -(1/2) , c = k/2 , d = -(1/2) , we find that 




-l4- 



P{-2 log W g < tj r= (1 - <f 2 )p{X^ < P g t) + 4, 2 P{X f 2 +4 ^ P2 t] + 0 ( n ’ : ') » 



where 



f p = p(k - 1) , 



(4. 9 ) P 2 =l- P -4^ , 



6 _ b( H - l)[p 2 1 (k - l) 2 - ?] 
2 48n 2 (p 2 ) 2 



To obtain an asymptotic expansion for the c.d.f. of the test statistic 
W under H , Anderson (1958; p. 255) goes back to the h -th moments of 
W and applies the Box expansion method ab initio . 

However, we already have the constants f^ , f^ , , p 2 , ^ , 

and <> 2 from the asymptotic expansions of the c.d.f. 's of and W 2 . 

Using Theorem 1 of Section 5, we thus conclude that the constants f , p , 
and o in the Box expansion (1.3) of the c.d.f. of W are given by 



(4.10) f = fp + f 2 - | (k - l)p(p + 3) , 



(4.11) 



P = 



f l P l + f 2 P 2 



_ i ( v i_ _ I \ 2p 2 + 3P - 1 _ P - k + 2 

' i=1 n i ” n • 6(p + 3)(k - 1) ” n(p + 3) ’ 



and 
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o = 



p l*l * p 2*2 f l f 2 , xJ 

2 + k 2 ^ P 1 ‘ P 2 

P 4p f 



(4.12) = — E-* [6( S -i-» - 4 )(p 2 - l)(p + 2) - 36(p + 5)(k - l)(l - p)‘ 



288 p 2 i=l (n^ 2 n 2 



— ( k ~ ^ (-2k 2 + 7k + 3pk - 2p 2 - 6p - 4)] 



n 



4.2 Test of K Versus H , . . 

mvc m'vc 1 



Gleser and Olkin (1972) show that the likelihood ratio test statistic 



\ . . for testing H against the alternative H , , is 

mvc, m'vc’ & mvc ° • m'vc' 






( I r v il?il "‘X! I (.\ v n + 

1=1 1 1=1 



mvc, m'vc' 



I h ( £ V (i) + A)F N 



i=l 



where 



(4.14) 




i = 1^ 2^ • • • ^ lc • 



However. instead of A , . . let us modify the statistic by replacing 

9 mvc. m’vc ' 9 

k 

N. by n. = N. - 1 , i = 1,2, ...,k , and N by n = E n. , everywhere 
11 1 ’ ’ i 

in (4.13). [There is more than one way to modify the likelihood ratio test 
statistic along the lines suggested by Bartlett (1937)* One way is given 




4G 
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here; another, and possibly preferable, way is considered in Gleser and 
Olkin (197 2 ).] The resulting statistic is 



(4.15) 



U 2 = 



k , /.\ in. . k / . \ i_ 

< » *> 4 < A v ii + V |2 

1=1 1 l=il 

| - ( 2 V (i) + A)|^ n 



i=l 



To obtain the c.d.f. of U g let be a similar modification of 

the likelihood ratio test statistic for testing hypothesis ^ m t vc ' against 
general alternatives. Gleser and Olkin ( 1972 ) have derived the likelihood 
ratio test statistic. From their result, we find that 



(4.16) 



u l = 



k 

JI 

i=l 



,(D f n i 

11 ' 



|i( E V<‘ ) .A„)|i" 



i=l 



11 ; 



Comparing the statistic W define'd in (4.4) with } an< * rec& 4Ling 

that |v^ | = Iv^llv^J for i = 1, 2, . . ., k , we see that 



O 
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(4.17) W = u x u 2 . 

Since under H , , the statistics xl^ - x^(V~^) > 

m vc d 1 11 Ld 7 

(v^jV 1 ^ > V 22?1 > 1 = > \,mA (J x v n J + A ii) are 

complete and sufficient, and since the distribution of is the same 

for all values of the parameters • • .,n^^ , 

obeying H , , , it follows from a theorem of Ba^ a (1955) that U. and 

m vc 1 

U 0 are statistically independent under H , , (and thus under H )• 

2 m vc mvc 

^7 



* 
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Note that has the same form as W , except that is a function 

only of x'*'(j) , j = 1, 2, . ..,N^ ; i = 1,2, ...,k . That is, is a 

q -dimensional version of W . The moments of W under H are known 

[they equal the product of (4.5) and (4.8)]. The moments of under 

H can be obtained from the formula for the moments of W by everywhere 
mvc 

replacing n by q . The moments of both U, and W under H are 

1 mvc 

thus of the form (l.l). Since U. and Ug are independent under , 

and since V/ = U, U_ , the h -th moment of U_ under H equals the 
1 2 ’ 2 mvc 

h -th moment of W under H divided by the h -th moment of U, 

mvc J 1 

under H . Thus the moments of U_ under H have the form (l.l). 

mvc 2 mvc 

From the preceding discussion and the results of Sections 1-5 

(particularly Theorem l), it follows that the c.d.f.'s of , Ug , 

and W all have asymptotic expansions of the form (l*3)* Let f , p , 

and <t> be the coefficients in the expansion (1.3) for the c.d.f. of W ; 

these constants are given by Equations (4.1D), (4.1l), and (4.12), 

respectively. Let f* , p* , and 4>* be the coefficients in the expan- 

6 6 S 

sion for the c.d.f. of U , g = 1,2 . Since U. is a q -dimensional 

S 1 

version of VJ , the coefficients f* , p* , and o* can be obtained 

by substituting q for p in the formulas (4.10), (4.11), and (4.12) 
respectively. Finally, from Theorem 1 we know that 



f = fj + fg , 



P = 



f*p* + f*p* 



(4.18) 



(p-*) 2 ** + (p*) 2 *| f*f| 
2 + "4f" (p l 



p %y 



o 
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Solving for f* , p£ , and <t>* in (4.l8) yields 
(4.19) l)(p - q)(p + q + 3) ; 



fp - f*p* k 

o* = — — = 1 - [ E — - £ ][ 

p 2 f* 1 i-x n n 



1 1 1r 2p 2 + 2pq ^ 2q 2 + 3p + 3q - 1 . 

6(p + q + 3)(k - 1) J 



(4.20) 



r P.M- ] 

1 n(p + q + 3) 



** 



p 2 « - ( P *) 2 o* 
(p*) 2 



qf| ( P * - p* 2 y 



4f 



( P %r 



(6[ z — - 4 ][(p 2 - i)(p 2 + 2p) - (q 2 - D(q 2 + 2 q)] 

(o*) 2 i=l (nj 2 n 2 



2S8(p*) 



(4.21) 



_ £ (I2)(k - l)(p - q) ][ 3 (p + q) (k. - 2) - 2(p 2 + pq + q 2 ) 
n 



2k 2 + 7k - 4] - 72f|(l - p|) 2 ) • 



We conclude that 

P{-2 log U 2 < t) - (1 - < Pjt) ♦ «F (X f|.4 - p 2 tJ + 0( " 5) ' 

(4.22) 

vhere f* , p£ , and <t>£ are given by (4.19), (^*20), and (4. 2l) 



respectively. 
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